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Appellant herein files an Appeal Brief drafted in accordance with the provisions 



Appellant respectfully submits that the above-captioned application is assigned, in 
its entirety to International Business Machines Corporation, Armonk, New York. 
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of 37 C.F.R. § 1.192(c) as follows: 



I. REAL PARTY IN INTEREST 
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II. RELATED APPEALS AND INTERFERENCES 

Appellant states that, upon information and belief, he is not aware of any co- 
pending appeal or interference which will directly affect or be directly affected by or have 
a bearing on the Board's decision in the pending appeal. 

III. STATUS OF CLAIMS 

Application Serial No. 09/602,278 (the instant application) as originally filed 
included claims 1-29. Claims 2-24 and 26-29 are pending. In response to the Office 
Action with a mailing date of 1/16/04 (paper no. 3), claims 1 and 25 were canceled and 
claims 2, 12, 13, 18, 26, and 27 were amended. Claim 18 was amended in accordance 
with the Examiner's suggestion to overcome a 35 U.S.C. 1 12, second paragraph, 
rejection. Claims 2 and 26 were amended to be of independent form, while independent 
claim 13 was amended to include the aspect of the hashing algorithm in correspondence 
with claim 2. Claims 12 and 27 were amended to maintain dependency on a pending 
claim. Claims 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19,20,21,22,23, 
24, 26, 27, 28, and 29 are on appeal and all applied prospective rejections concerning 
Claims 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20,21,22, 23,24, 26, 
27, 28, and 29 are being appealed herein. 

IV. STATUS OF AMENDMENT 

All amendments made to the instant application were entered. 
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V. SUMMARY OF THE INVENTION 

The present invention provides method and system aspects for automated monitoring 
of quality of service of digital video material being distributed and played. The aspects 
include embedding a signature in each frame of the digital video material by a program source 
device control by utilizing a hashing algorithm to produce the signature for each frame in the 
digital video material during encoding of the digital video material. Computation of play-out 
statistics for the digital video material based on the signature by a program play-out device 
control is also included. 

Through the present invention, determining statistics on a particular video 
program occurs in a manner that avoids intensive manual human monitoring and provides 
a more efficient and automatic ability to achieve quality of service measurements. The 
present invention utilizes technology to embed hidden data into a video or associate data 
with the video file, and provides the ability to take correlated hidden data and video 
images together that an application can then process to do applications such as billing, 
quality of service measurements, rights management, and external device control. 

VI. ISSUES 

The issues presented are: 

(1) whether claims 2, 12-16, 19-24, and 26-29 arc unpatentable under 35 U.S.C. 103(a) 
over Copriviza et al ("Copriviza") in view of Echeita et al ("Echeita") and further in view of 
Iggulden; 

(2) whether claim 3 is unpatentable under 35 U.S.C. 103(a) over Copriviza in view of 
Echeita and Iggulden and further in view of Linnartz; 
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(3) whether claim 17 is unpatentable under 35 U.S.C. 103(a) over Copriviza, Echeita, 
and Iggulden and further in view of Caporizzo; 

(4) whether claims 4-1 1 are unpatentable under 35 U.S.C. 103(a) over Copriviza, 
Echeita, and Iggulden and further in view of Goodman et al ("Goodman"); and 

(5) whether claim 1 8 is unpatentable under 35 U.S.C. 103(a) over Copriviza, Echeita, 
and Iggulden and further in view of Goodman. 

VII. GROUPING OF CLAIMS 

Appellant hereby states that claims 2-24 and 26-29 form one group. 

VIII. ARGUMENTS 
A. Summary of the Applied Rejections 

In the final office action dated 6/7/04 (paper no. 6), the Examiner rejected: claims 
2, 12-16, 19-24, and 26-29 under 35 U.S.C. 103(a) as being unpatentable over Copriviza in view 
of Echeita further in view of Iggulden; claim 3 under 35 U.S.C. 103(a) as being unpatentable 
over Copriviza in view of Echeita and Iggulden and further in view of Linnartz; claim 17 under 
35 U.S.C. 103(a) as being unpatentable over Copriviza, Echeita, and Iggulden and further in 
view of Caporizzo; claims 4-1 1 under 35 U.S.C. 103(a) as being unpatentable over Copriviza, 
Echeita, and Iggulden and further in view of Goodman; and claim 18 under 35 U.S.C. 103(a) as 
being unpatentable over Copriviza, Echeita, and Iggulden and further in view of Goodman. 

In making the rejection, the Examiner cites Copriviza for disclosing the recited 
embedding of a signature in each frame of video material and computing play-out statistics 
based on the signature but admits that Copriviza fails to disclose that the video material is 
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digital. Echeita is cited for teaching a method for monitoring quality of service of digital video 
for combination with Copriviza. Both Copriviza and Echieta are admitted by the Examiner as 
failing to disclose utilizing a hashing algorithm to produce the signature. Thus, the Examiner 
cites Iggulden for combination with Copriviza and Echeita, and states, "Iggulden discloses 
utilizing a hashing algorithm to produce a signature for each frame in a video material (col. 6, 
lines 25-36), allowing the material to be quickly identified in real time." Further, the 
Examiner states: 

[Applicant argues that Iggulden fails to teach or suggest using a hashing 
algorithm to produce a signature in each frame. It is Copriviza who teaches 
adding a signature to each frame (col. 8, lines 26-39). Iggulden teaches 
generating signatures using hash codes, which has the inherent and well 
known benefit of high speed locating of representative data objects when 
hash codes are used. It is the combination of Copriviza and Iggulden which 
meets the limitation of using a hashing algorithm to produce a signature in 
each frame. 

Appellant respectfully requests that the Board reverse the Examiner's final 
rejection of the pending Claims. 

B. The Cited Prior Art 

Copriviza discloses unique digital codes that are encoded on a video signal, the 
codes are retrieved at receivers and precise information concerning the time of 
occurrence, length, nature and quality of a monitored broadcast at a frame by frame level, 
is generated. The codes are inserted on scan lines of the video, and vary either on a field- 
to-field or frame-to-frame basis. The code has a repeating first part having a unique 
program material identifier indicating the time, date and place of encoding, and has a 
second portion that varies in a predetermined non-repeating sequence which varies along 
the entire length of the tape, thereby uniquely identifying each frame of the video program 
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material. Also encoded upon successive frames is a cyclic counter code with a count 
corresponding to the sequence of the identifier data on successive frames. When the video 
signal is processed by a receiver, the first portion identifier data from the various frames 
is mapped into selected memory locations in accordance with the count of the frame as 
determined by the second portion. Odd and even fields are encoded with complementary 
bit sequences to assist in processing the encoded data. Whenever the frame sequence is 
interrupted a data packet is generated representative of the condition encountered. The 
data packets are accumulated in log files in a memory in the receiver. The log files are 
transmitted to a data center, as is a copy of the encoded tape. Reports concerning the 
broadcast are generated. 

Iggulden discloses a method and apparatus that identify selected broadcast 
segments, such as commercial advertisements, of a television signal in real-time for the 
purpose of muting the video and audio portions of the television signal during each 
unwanted segment. A signature pattern associated with each segment of the television 
signal is detected and compared to stored signature patterns representative of selected 
segments such as commercial advertisement segments. If the signature pattern matches 
one of the stored signature patterns, the segment is thereby immediately identified as 
being one of the selected segments and is processed in real-time to mute the audio and 
video portions of the television signal during the segment. If the signature pattern of the 
segment does not match any of the stored signature patterns, the segment is analyzed to 
determine whether the segment is nevertheless a selected segment and, if so, its signature 
pattern is stored along with the stored signature patterns. The analysis to determine 
whether the segment is nevertheless a selected segment is performed by detecting the 
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length of the segment upon its completion and then determining whether the length of the 
segment matches one of a pre-determined set of permissible selected segment lengths 
such as standard commercial advertisement segments of 15 seconds, 30 seconds, or 60 
seconds. If so, the segment is identified as being a selected and its signature pattern is 
stored along with the other stored signature patterns such that, the next time the same 
segment is encountered, its signature will then match the stored signature and therefore 
the segment can be immediately identified and muted in real-time. 

Echeita discloses an apparatus and method that utilize the digital packetized 
transmission features of a direct broadcast satellite (DBS) system to provide an automated 
and efficient method of conducting advertisement reconciliation. The apparatus and 
method of the present invention inserts advertisement reconciliation data packets into the 
transmitted DBS data stream. Preferably, the inserted reconciliation data packets are 
transmitted synchronously with the advertisement data packets to which they are related. 
The reconciliation data may include data identifying the date on which the advertisement 
is aired, the time at which the advertisement is aired, the duration of the advertisement as 
aired, the contract number under which the advertisement was purchased, the particular 
order line number of the contract under which the advertisement was purchased, the 
"makegood" status (indicates whether the advertisement is a makegood an advertisement 
that was missed), the scheduled time and duration of the advertisement, and an 
identification code identifying a particular advertisement. 

Caporizzo discloses a system for determining the quality of data received by 
settop terminals including at least one settop terminal which analyses each data packet 
received by the settop terminal and determines whether the received data packet includes 
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errors. The bit error rate is continually calculated, monitored and stored. When the bit 
error rate exceeds a predetermined threshold, the settop terminal generates a warning 
signal for transmission to the headend, which diagnoses the problem. The cable system 
headend utilizes the results from a group of households that have the same problem in 
order to isolate the source of failure. 

Goodman discloses advertising that is marked with a code in a way which makes 
it difficult to fool the system. The advertising is marked with a code at the time the 
advertising is produced. Then, when the advertising is broadcast, the code on the 
advertising is analyzed. Different security measures can be used, including producing the 
code in the closed captioning so that many different people can see the code, or 
comparing codes in one part of the signal with a code in another part of the signal. 
Measures are taken to prevent the code from being used to detect commercials. According 
to another part of this system, a paradigm for a clearinghouse is disclosed in which the 
user signs up with the clearinghouse, obtains a line of credit, and the advertiser, the 
agency, and the ad producer also subscribe to the service. When the ad is actually aired, 
the payment can be automatically transferred. 

C. Claims 2-24 and 26-29 Are Not Unpatentable Under 35 U.S.C. 103(a) 

In the present invention, automated monitoring of quality of service of digital video 
material being distributed and played occurs. The automated monitoring includes embedding 
a signature in each frame of the digital video material by a program source device control with 
computation of play-out statistics for the digital video material based on the signature by a 
program play-out device control. The present invention also includes utilizing a hashing 
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algorithm to produce the signature for each frame in the digital video material during encoding of 
the digital video material, as recited in varying form in independent claims 2, 13, and 26. 

In making the rejection, the Examiner cites Copriviza for disclosing the recited 
embedding of a signature in each frame of video material and computing play-out statistics 
based on the signature but admits that Copriviza fails to disclose that the video material is 
digital. Echeita is cited for teaching a method for monitoring quality of service of digital video 
for combination with Copriviza. Both Copriviza and Echieta are admitted by the Examiner as 
failing to disclose utilizing a hashing algorithm to produce the signature. Thus, the Examiner 
cites Iggulden for combination with Copriviza and Echeita, and states, "Iggulden discloses 
utilizing a hashing algorithm to produce a signature for each frame in a video material (col. 6, 
lines 25-36), allowing the material to be quickly identified in real time." 

In the cited section of col. 6, lines 25-36 of Iggulden, Iggulden merely mentions that a 
signature being detected from a segment of a television broadcast "may, for example, be a 
binary hash code." Appellant respectfully submits that Iggulden fails to teach, show, or 
suggest that a hashing algorithm is utilized to produce the signature for each frame in the digital 
video material and/or during encoding of the digital video material, as recited in the independent 
claims. Referring to Figures 8, 9, 10, and 1 1 of Iggulden and their discussion (col. 15, line 
29+), the 'signature' is Iggulden is taught as being 'read' after receipt of the television 
broadcast signal and upon detection of an event marker in the television signal. The 'reading' 
of the signature actually involves producing a bit string based on luminance levels of selected 
lines from a single test frame of the received data. 

Thus, the signature is formed after receipt of the test frame during broadcast, and not 
as a part of any type of encoding. In contrast, utilization of the hashing algorithm to produce 
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the signature in Appellant's recited invention occurs by a program source during encoding. 
Further, while Iggulden utilizes a single test frame to produce a signature for the received 
signal, Appellant fails to see any teaching or suggestion that each frame has a signature that is 
generated utilizing a hashing algorithm, as recited in Appellant's invention. Therefore, 
Appellant respectfully submits that by not including a signature produced with a hashing 
algorithm in every frame, and by not producing the signature with a hashing algorithm during 
the encoding of the video material, Iggulden fails to teach or suggest the recited hashing 
algorithm used to generate a signature in every frame of digital video material. 

Additionally, Iggulden does not teach or suggest that a hash code signature is needed 
for digital television signals. Rather, Iggulden states that "if the television signal is digital, ... 
the signature is simply based on selected bits within one or more selected digital frames." 
(col. 19, lines 12-14) Thus, there is nothing from Iggulden to teach or suggest that digital 
video material utilizes a signature in every frame produced with a hash code algorithm during 
encoding of the digital video material. 

In response, the Examiner states: 

[Applicant argues that Iggulden fails to teach or suggest using a hashing 
algorithm to produce a signature in each frame. It is Copriviza who teaches 
adding a signature to each frame (col. 8, lines 26-39). Iggulden teaches 
generating signatures using hash codes, which has the inherent and well 
known benefit of high speed locating of representative data objects when 
hash codes are used. It is the combination of Copriviza and Iggulden which 
meets the limitation of using a hashing algorithm to produce a signature in 
each frame. 

Appellant respectfully disagrees that the combination of Copriviza and Iggulden meets the 
limitation of using a hashing algorithm to produce a signature in each frame. 

In addition to the deficiencies of Iggulden, Copriviza discloses in col. 8, lines 26-40, 
the encoding of a video tape of program material with a "predetermined unique and non- 
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repeating sequence 55 as a means of individually and uniquely identifying each and every frame 
of the video program material. Copriviza further discloses in col. 15, lines 50-64, that in a 

preferred embodiment each frame is numbered successively. ... It will be 
appreciated that the consecutive frame numbering system ... is merely one 
of many sequential frame number systems that may be used to identify 
each and every frame individually and uniquely. For example, succeeding 
frames in the program may be numbered in any predetermined sequence as 
long as the decoders in the field receivers 36 are programmed to recognize 
this sequence as being the normal sequence of a program which is 
received without interruption. 

Copriviza clearly uses a numbering sequence in order to provide the unique identification of 
successive frames. As such, while the number in each frame will vary, it has context relative 
to preceding and successive frames based on the numbering sequence used. It is this context 
that is utilized in Copriviza to determine whether a frame sequence discontinuity (FSD) packet 
needs to be generated: (col. 15, lines 44-49) "An FSD packet is generated ... when successive 
frames are not in the proper sequence in which data is encoded...' 5 Thus, without such use of a 
numbering sequence to provide context, the manner of producing the FSD packets is 
compromised, and the system of Copriviza is fundamentally altered. 

The Examiner asserts in the Advisory Action dated 10/6/04 that "Copriviza clearly 
teaches adding signature information which uniquely identifies each individual frame of 
video, but does no [sic] rely exclusively on a numbering sequence for said identification, thus 
the inclusion of a hashing function to generate said information is a rational and feasible 
option." Appellant respectfully disagrees. In fact, in each of the quotes from Copriviza 
included by the Examiner in the Advisory Action, there is reference by Copriviza to a 
"predetemined unique and non-repeating sequence", that "each encoded frame is numbered 
successively", and that "the consecutive frame numbering system ... is merely one of many 
sequential number systems that may be used to identify each and every frame individually and 
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uniquely/' As demonstrated by these quotes, Copriviza clearly teaches that unique and 
individual frame identification occurs by using a sequential number system. 

Appellant fails to see how the use of a sequential number system to identify successive 
frames in a program from Copriviza can be combined with the disclosure of a hash code 
signature utilizing a single test frame in Iggulden, since there is nothing to teach or suggest 
that a hash code signature from a single test frame could or would be used to provide a 
predetermined unique and non-repeating sequence (i.e., a sequential number system), as 
required by the identifier signature of every frame in Copriviza. 

Accordingly, Appellant respectfully submits that Copriviza in view of Echeita, and 
further in view of Iggulden fails teach, show, or suggest use of a hashing algorithm to produce 
the signature for each frame in the digital video material and/or during encoding of the digital 
video material, as recited in the independent claims 2, 13, and 26. Accordingly, Appellant 
respectfully requests withdrawal of the rejections of independent claims 2, 13, and 26. 

Further, claims 3-12, 14-24, and 27-29 depend directly or indirectly on one of the 
independent claims. Thus, these claims incorporate the features of one of the 
independent claims, while adding other features. Accordingly, these claims also are 
respectfully submitted as allowable over the cited art for at least those reasons associated 
with the independent claims, as presented herein. In addition, Appellant respectfully 
submits that none of the art cited (Linnartz, Caporizzo, Goodman) in the separate 
rejections for some of these dependent claims is sufficient to overcome the deficiencies of 
Copriviza in view of Echeita and further in view of Iggulden. Therefore, Appellant 
respectfully requests withdrawal of the rejections against these claims. 
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In view of the foregoing, Appellant respectfully submits that claims 2-24 and 26- 
29 are not taught, shown, or suggested by the cited art. 

Accordingly, Appellant respectfully requests withdrawal of the rejection under 35 
U.S.C. 103(a) and respectfully requests that the Board reverse the final rejection of 
Claims 2-24 and 26-29. 

D. Summary of Arguments 

For all the foregoing reasons, it is respectfully submitted that Claims 2, 3, 4, 5, 6, 
7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20,21,22, 23,24, 26, 27, 28, and 29 (all the 
Claims presently in the application) are patentable for defining subject matter which 
would not have been unpatentable under 35 U.S.C. § 103(a). Thus, Appellant 
respectfully requests that the Board reverse the rejection of all the appealed Claims and 
find each of these Claims allowable. 

Note : For convenience of detachment without disturbing the integrity 
of the remainder of pages of this Appeal Brief, Appellant's 
"APPENDIX" section is contained on separate sheets following the 
signatory portion of this Appeal Brief. 
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This Brief is being submitted in triplicate, and authorization for payment of the 
required Brief fee is contained in the cover letter for this Brief. Please charge any fee that 
may be necessary for the continued pendency of this application to Deposit Account No. 
09-0460 (IBM Corporation). 

Respectfully submitted, 

January 12, 2005 

Date 





/wktph A/Sawydf^ Jr. 
^Sawyer Law Group LLP 
Attorney for Appellant(s) 
Reg. No. 30,801 
(650) 493-4540 
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IX. APPENDIX 



2. A method for automated monitoring of quality of service of digital video material 
being distributed and played, the method comprising: 

embedding a signature in each frame of the digital video material by a program source 
device control by utilizing a hashing algorithm to produce the signature for each frame in the 
digital video material during encoding of the digital video material; and 

computing play-out statistics for the digital video material based on the signature by a 
program play-out device control. 

3. The method of claim 2 further comprising providing a key identifier in a header of the 
signature and identifying inclusion of the signature based on the key identifier. 

4. The method of claim 2 wherein embedding further comprises creating a meta-stream 
for the digital video material and encrypting the meta-stream. 

5. The method of claim 4 wherein the meta-stream further comprises a header 

session. 

6. The method of claim 5 wherein the header session further comprises an identifier, a 
length, and a time of play-out of the digital video material. 
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7. The method of claim 4 wherein the step of computing statistics further comprises 
capturing the meta-stream and computing the signature for an incoming stream of digital video 
material. 

8. The method of claim 7 further comprising utilizing the signature of the meta-stream 
to trigger comparison with the computed signature of the incoming stream of digital video 
material. 

9. The method of claim 8 further comprising computing a number of frames having a 
matching signature to the computed signature, identifying a time of play-out for the video stream, 
and determining a duration of the digital video material played-out. 

1 0. The method of claim 9 further comprising storing the play-out statistics on a local 
storage device for the play-out device control. 

1 1 . The method of claim 1 0 further comprising transmitting the play-out statistics back 
for the program source device control for quality of service measurements. 

12. The method of claim 2 wherein the digital video material further comprises a digital 
advertisement. 

1 3 . A system for automated monitoring of quality of service of digital video material 
being distributed and played, the system comprising: 
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a program source of viewing program data, the program source embedding a signature 
in each frame of digital video material within the viewing program data by utilizing a hashing 
algorithm to produce the signature for each frame in the digital video material during encoding of 
the digital video material; 

a play-out device for receiving the viewing program data and computing play-out 
statistics for the digital video material based on the signature; and 

a display device coupled to the play-out device for displaying video output of the 
viewing program data from the play-out device. 

14. The system of claim 1 3 wherein the viewing program data further comprises a cable 
station program feed. 

1 5. The system of claim 1 3 wherein the viewing program data further comprises a 
satellite program feed. 

1 6. The system of claim 1 3 wherein the viewing program data further comprises an air 
wave program feed. 

17. The system of claim 13 wherein the play-out device further comprises a set-top 
cable box. 

1 8. The system of claim 1 3 wherein the play-out device further comprises a play-out 
device within a cable head-end. 
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19. The system of claim 13 wherein the play-out device further comprises a computer. 

20. The system of claim 13 wherein the digital video material further comprises a digital 
advertisement. 

21 . The system of claim 13 wherein the program source further provides the signature in 
a meta-stream, the meta-stream including an identifier for the digital video material, a length of 
the digital video material, and a time for play-out of the digital video material. 

22. The system of claim 21 wherein the play-out device further computes play-out 
statistics by capturing the meta-stream, computing a signature for the digital video material, and 
comparing the computed signature to the provided signature. 

23. The system of claim 22 wherein the video play-out device further computes statistics 
by computing a number of frames in the digital video material having a match condition with the 
signature, identifying a time of play-out of the digital video material, and determining a duration 
of the digital video material actually played-out. 

24. The system of claim 23 wherein the video play-out device stores the play-out 
statistics in a local storage and transmits the play-out statistics to the program source, wherein the 
program source measures quality of service for the digital video material from automated 
analysis of the play-out statistics. 
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26. A method for achieving automated monitoring of quality of service of digital video 
material play-out in a video distribution and display system, the method comprising: 

embedding video source material at a program source with hidden data and a meta- 
stream for uniquely marking a digital advertisement with the video source material, wherein the 
hidden data further comprises a signature generated by a hashing algorithm for each frame of the 
digital advertisement; 

isolating the meta-stream and the digital advertisement from the video source material in 
a program play-out device; and 

utilizing the meta-stream in the program play-out device to determine play-out statistics 
for the digital advertisement. 

27. The method of claim 26 wherein the meta-stream further includes an identifier for 
the digital advertisement, a number of frames of the digital advertisement, and a time for play-out 
of the digital advertisement. 

28. The method of claim 27 wherein the play-out statistics further comprise a start-time 
of play-out, a number of frames in the digital advertisement correctly decoded, and an end-time 
of play-out of the digital advertisement. 

29. The method of claim 28 further comprising providing the play-out statistics to the 
program source, and analyzing the play-out statistics to determine quality of digital 
advertisement display. 
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